منابع مشابه
Occupation laws for some time-nonhomogeneous Markov chains
We consider finite-state time-nonhomogeneous Markov chains whose transition matrix at time n is I + G/nζ where G is a “generator” matrix, that is G(i, j) > 0 for i, j distinct, and G(i, i) = − ∑ k 6=iG(i, k), and ζ > 0 is a strength parameter. In these chains, as time grows, the positions are less and less likely to change, and so form simple models of age-dependent time-reinforcing schemes. Th...
متن کاملTaylor Expansion for the Entropy Rate of Hidden Markov Chains
We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملMeasure - Theoretic Boundaries of Markov Chains , 0 - 2 Laws And
The classic Poisson formula giving an integral representation of bounded harmonic functions in the unit disk in terms of its boundary values has a long history (as it follows from its very name). Given a Markov operator P on a state space X one can easily deene harmonic functions as invariant functions of the operator P, but in order to speak about their boundary values one needs a boundary, be...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Probability
سال: 1977
ISSN: 0091-1798
DOI: 10.1214/aop/1176995759